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INDUCTION OF MARKOV CHAINS, DRIFT FUNCTIONS AND 
APPLICATION TO THE LLN, THE CLT AND THE LIL WITH A 
RANDOM WALK ON AS AN EXAMPLE. 

JEAN-BAPTISTE BOYER 


Abstract. Let (X n ) be a Markov chain on a standard borelian space X. Any stopping 
time t such that E^r is finite for all £ £ X induces a Markov chain in X. In this article, 
we show that there is a bijection between the invariant measures for the original chain 
and for the induced one. 

We then study drift functions and prove a few relations that link the Markov opera¬ 
tor for the original chain and for the induced one. The aim is to use this drift function 
and the induced operator to link the solution to Poisson’s equation (Id — P)g = / for 
the original chain and for the induced one. 

We also see how drift functions can be used to control excursions of the walk and to 
obtain the law of large numbers, the central limit theorem and the law of the iterated 
logarithm for martingales. 

We use this technique to study the random walk on R+ defined by X n +i = ma.x(X n + 
Y n+ i, 0) where (Y n ) is an iid sequence of law for a probability measure p having a 
finite first moment and a negative drift. 
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Introduction 

For a standard Borelian space X, let 9 be the shift on X N . 

Let (X n ) be a Markov chain on X. We define a Markov operator on X setting, for a 
borelian function /, Pf(x) = E[/(Xi)|X 0 = x] = E x f(Xi) = f /(Xi)dP x ((X„)). 
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Given a stopping time r such that for any 16 X, F x (r < oo) = 1, we can study the 
Markov chain (X T n) ng ^ where r n is defined by 

r r°((X n )) = 0 

l T k+ \{x n )) =T k ((x n )) + T(e^ x ^(x n )) 

We call ( X r n ) the induced Markov chain and we note Q the Markov operator associated 
to it, that is, for a borelian function g on X, 

Q(g)(x)= f g(X T )cW x ((X n )) 

J {r<+oo} 

We define two operators on X by setting, for a borelian non negative function / and 
x £ X, 


Sf(x) = I /(Xi) dP x ((X n )) 

J{r= 1} 

Rf(x) = [ f(x o) + • • • + /(X r _!)dP x ((X n )) 

J {r<+oo} 


First, these operators allow us to prove the following lemma which is a gneralization 
of Kac’s lemma for Markov chains. 


Lemma (1.5). Let (X n ) be a Markov chain on a complete separable metric space X. 

Let pi be a finite P—invariant measure on X and t a 9— compatible stopping time (see 
definition 1.1) such that for p-a.e x G X, lim n _ s . +00 P x (r ^ n) = 0. 

For any non negative borelian function f on X, we have 

[ fdp = [ SRfdp 

Jx Jx 

Actually, the operator R is implicitely defined (and studied) by many authors (see for 
instance [Kre85], the end of §3.4, the sub paragraph called “Induced operators” where 
he even proves our generalization of Kac’s lemma in the case of a stopping time which 
is the first return to some set) but this functional analytic point of view we developp 
allows us to deal with it easily and, using the operator S, we don’t need the stopping 
time to be the first return to some set. 

Moreover, it allows us to prove the following 

Corollary (1.10). Let ( X n ) be a Markov chain on a complete separable metric space X 
and t a 9—compatible stopping time (see definition 1.1) such that for any x E X, E x t 
is finite. Define P, Q, R and S as previously and assume that QR1 is bounded on X. 

Then, S * and R * are reciproqual linear bijections between the P—invariant finite mea¬ 
sures and the Q—invariant ones which preserve ergodicity. 


For us, the aim is to prove the central limit theorem for which a standard technique is 
to find a solution of the ‘Poisson equation” g — Pg = / for / in a certain Banach space. 

Indeed, Maigret showed in [Mai78] that if the chain is positively Harris recurrent with 
unique invariant measure p and / G L 2 (X, p) is such that there exist g E L 2 (X, p) with 
f = g — Pg, then the CLT holds for / and p— a.e starting point. 
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The first idea to solve this equation was to find a spectral gap in some nice space. In 
particular in L 2 (X,/r) where p is an invariant measure. This is used by many authors 
(see for instance [Ros71]). 

An other idea, is to use a stopping time to induce a Markov chain whose study is 
easier. Glynn and Meyn, in [GM96], used this to get the CLT for any starting point 
assuming the chain is irreducible and there exist a so called petite set (a set where the 
induced chain becomes iid). They used a stopping time which was the time of first return 
to the petite set to create a pseudo-atom (see [Num78] and [Che99]) and find a solution 
to Poisson’s equation. 

This is this technique we study in section 2 and where we show how to find a solution 
for the Poisson’s equation for the original chain when we can solve it for the induced one 
when there is what we call a “drift function” (see proposition 2.15 and remark 2.17). 
Actually, when the petite set is compact, one can prove that the induced operator is 
quasi-compact. 

We then use this relations to prove a Law of large numbers for martingales (propo¬ 
sition 3.3) and that what Brown calls the Lindeberg condition in [Bro71] holds in 
lemma 3.4. This is a first step towards the central limit theorem and the law of the 
iterated logarithm for martingales as we see in corollary 3.5. 

Finally,we use this technique to study the random walk on M + defined by 

Xn+i — il 1 rlx( X. n + 0) 

where (Y n ) is an iid sequence of law for a probability measure p having a quadratic 
moment and a negative drift and we will prove the following 


Proposition (4.5). Let p be a probability measure on M having a finite first moment 
and a negative drift A = J R ydp(y). 

Then, the random walk on M + have a finite invariant probability measure p. 
Moreover, for any a £ M +J if there is e £ such that f R \y\ 2+a+£ dp(y) is finite, then 
for any f £ and any x £ M+, 


n— 1 ,, 

Y f{X k ) -» / fdp a.e. and in L 1 (P X ) 

J n—>-+oo / 

k=0 J 


Finally, if there is e £ such that f R \y\ 4+a+e dp(y) then for any f £ £ Ua and any 
x £ M+, 

71—1 „ 


^nC f,x) = 

n 


yf(x k )~ / fdp 


k=0 


converges to some cr 2 (f) and if & 2 (f) / 0, then 


71—1 


— \f(X k )^Ml / fdp,a 2 (f) 


k=0 


and 

,. YJlzlf{x k )-!fdp 

Inn sup — 

yj2na 2 (f) lnln(n) 


1 a.e. and liminf 


n= 0 f(Xk)-ifdp 

y / 2 n(j 2 (/) lnln(n) 


— 1 a.e. 
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1. Induced Markov chains 

1.1. Definitions. Let (X n ) be a Markov chain on a standard Borel space X. We define 
a Markov operator on X setting, for a borelian function / and x 6 X, 

Pf(x)=E[f(X 1 )\X 0 = x\ 

Given a stopping time r, we can study the Markov chain (X T n) ng pj where r n is defined 

by 

f T°((Xn)) = 0 

1 T k+1 ((X n )) = r k ((X n )) + r(^ fc « x "))(X n )) 
where 8 stands for the shift on X f: . 

We note Q the sub-Markov operator associated to (X T n), that is, for a borelian func¬ 
tion g on X and x 6 X, 

Q(g)(x) = [ g{X T ) dP x ((x n )) 

J {r<+oo} 

If, for any x € X, P x (r is finite) = 1, then Q is a Markov operator. 

Finally, we define two other operator on X setting, for a borelian non negative func¬ 
tion / and x € X, 

(1-1) Sf(x) = f f (Xi)dF x ((X n )) 

r=l} 

(1.2) Rf(x)= [ /(X 0 ) + ... + /(X r _ 1 ) dP a ((X n )) 

J {r<+oo} 

Definition 1.1 {6 —compatible stopping times). 

We say that a stopping time r is 8 —compatible if for all x G X, Pa;({T = 0}) = 0 and 
for P x —a.e. (X n ) G X N , r((X n )) ^ 2 implies that t{8{X„)) = r((X n )) - 1. 

Example 1.2. If r is bounded (there exits M G M such that for any i£X and P^,—a.e 
(X n ) G X I! , r ^ M), then r is not 0—compatible. In particular, for any stopping time 
t and any n 6 N, min(r, n) is not 8— compatible. 

Example 1.3. Let Y be a borelian subset of X and ty the time of first return in Y: 

r Y ((X n )) = inf{n € N*; X n g Y} 


Then, r Y is 8— compatible. 

Moreover, Ty as we defined it coresponds to the time of n-th return to Y. 

For x £ X, we set u(x) = IE^ty and we call Y strongly Harris-recurrent if u is finite 
on X. This imply in particular that for any x in X, rY is P x —a.e. finite. 

Indeed for any borelian non negative function / and any x € X, we have that 
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+oo 


Qf(x) = 


n 

/ f{X r )dP x = J2®xf(Xn)l{T=n} 

J { t <+ 00} n=1 

+OO 

x /(X n )l Y c(X 1 )... Iyc^^Iy^) 

n= 1 

+00 +00 

p(f iy) = ^(pi Y c) n P(/i Y ) 


n=l 


n=0 


/* +00 

i?/(*) = / /(*o) + • • • + /(X T _ i)dP x = X> x /PQ 1 {t ^ +1 } 

• / {r<+ 0 °} n =0 

+OO 

= /(x) + ^E. r /(X n )lY C (X!) . . . l Y c{X n ) 


n= 1 
+00 


+00 


/M + E( p iY“)”(/)W = E( p iv)”(/)W 


n= 1 


n=0 


5/(x) = / /(Xi)dP x = / /(XOlY^OdP, = P(fly) 

J{t= 1} ./ 

Thus, we have that (P + Q)f = (Id + RP)f, RSf = Qf , (P — S)Qf = P(1y c Q/) = 
Qf - Sf and (P - S)P/ = P(l Y cP/) = Rf-f. 

Note that P, Q, R, S, P — S,Q — S and R — Id are positive operators and so the 
computations we made make sense for any non negative borelian function /. 

Next lemma generalizes those relations for any 9— compatible stopping time. 

Proposition 1.4. Let r be a 9—compatible stopping time such that for any x € X, r is 
P x —a.e. finite. 

For any non negative borelian function f on X, we have : 

(R + Q)f = (I d + RP)f 
(I d + PR)f = (Id + S)Rf 
(Id + S)Qf = (S + PQ)f 
RSf = Qf 

Proof. Let / be a borelian non negative function on X and x £ X. 

Using the Markov property and r being a 9— compatible stopping time, we have that 
for any n 6 N*, 

E x /(-Xn)l{r>n} = E z P/(X n _i)l{ r ^ n | 
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And so, 


+OO 


(R + Q)f(x) = E x /(X 0 ) + • • • + f(X T ) dP x = E* E f(X n )l {T>n} 


n =0 


+00 


/(*) + E ®xPf (Xr^l)l {T>n } = f(x) + RPf{x) 


n= 1 


Moreover, as r is 9— compatible, 

Rf(Xi) dP x ((X n )) = / /(Ar) + • • • + /(X^dP^XP) 


'{t> 2} 


Thus, 

f{x)+PRf(x) = f{x)+ f Rf(X 1 )dF x ((X n ))+ [ Rf(X x ) dP x ((X n )) 

J{r=l} J{r^2} 

= /(x) + Si2/(x) + / /(X x ) + • • • + /(A r _ 1 )dP x ((X ri )) 

■/{r^2} 

= SRf{x) + J f(X 0 ) + • • • + /(X T _!)dP x ((A n )) = Sfl/(x) + Rf(x) 
Then, by definition of S, /{ r=1 } /(Xi)dP x ((X„)) = J {r=1} /(X T )dP x ((X n )), so, 

Sf(x) + PQf{x) = J 1 {T=1} (/(Xr) + g/(Xi)) + l { r> 2 } /(Xr)dPa;((X n )) 

= SQf(x) + Qf{x) 

Finally, for any n G N*, 

E x 5/(X n _!)l {T>n} = / /(X n+1 ) 

J {r=n-\-l} 

therefore, 

+00 +00 

= E x E 5/(X n _!)l {T>n} = EE*S/(X„-i)V } 


77.—1 


77—1 


E E a;/(X n+ i)l{ r=n+1 } = Qf(x) 


77 — 1 


□ 


Lemma 1.5. Let p. be a finite P—invariant measure on X and r a 0— compatible stopping 
time such that for p-a.e x G X, lim n ^. +00 P x (r n) = 0. 

For any non negative borelian function f on X, we Ziaue 

[ fdp = [ SRfdp 
ix ix 

Proof. According to proposition 1.4, / + PRf = Rf + SRf. So, if Rf € L 1 (X, p), as p 
is P—invariant, we get the lemma. 

If / 0 L 1 (X,/r), we will get the lemma by approximation. 
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First, we assume that / is bounded. In general, Rf 0 L 1 (X,/i) so, we approximate it 
with a sequence of integrable functions. 

More precisely, for n G N*, we note R„ the operator defined like R but associated to 
the stopping time min(n,r) (which is not 8— compatible). 

That is to say, for a borelian non negative function / and any x G X, 

min(r,n) — 1 

Rnf(x) =E X /(**) 

k =0 

As {min(r, n) = 1} = {r = 1} for n ^ 2, the operator S associated to min(r, n) does 
not depend on n for n ^ 2. 

As min(r, n) is not 8— compatible, we can’t use proposition 1.4, but we have for n ^ 2, 
that 

min(ro6,n) — 1 

PR n f(x) =E X f( x k+i) 

k =0 

min(r— l,n) — 1 

= SR n f(x) + / V f(X k+1 )d¥ x 

k=Q 

min(r,n+l)—1 

= SR n f(x) + [ V /(X fc )dP x = + i? n+ i/ - / 

^{^2} ^ 

And, as / is bounded, for any x E X, |i? n /(x)| ^ u||/||oo and so R n f is integrable 
since /x is a finite measure and, 


J SR n f - fdfi = J PRnf - Rn+lfdfi = j R n f - R n+1 fdfl 

= J f(X n )l {T>n} d¥ x ((X n ))dii(x) 

= I P/(X n _ 1 )l {r>n} dF ;c ((X n ))d M (x) 

So, 


SRnf - fdfj, 


€ 


lx 


5 ({r ^ n}) dfi(x) —> 0 (by monotone convergence) 


and using the monotone convergence theorem, we get the expected result for borelian 
bounded functions. 

If / is not bounded and not negative, we take (f n ) to be an increasing sequence of 
bounded positive functions which converges to / and we get the expected result by 
monotone convergence. □ 


Example 1.6. If t is the return time to some strongly Harris-recurrent set Y, then 
Sf(x ) = P(f 1y)(*)- Moreover for every P— invariant measure fi and every / € L 1 (X, //), 
such that Rf is /i— a.e. finite, f x SRfdfi = f Y Rfdfi. 

In particular, with / = 1, we have that, f Y Erd/j, = /x(X). This is Kac’s lemma for 
dynamical systems. 
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1.2. Application to the study of invariant measures. In this subsection, X is a 
complete separable metric space endowed with it’s Borel tribe and “measure” stands for 
“borelian measure”. We assume that there exist (at least) a P— invariant probability 
measure on X. 

We also fix a 9 —compatible stopping time t such that for any x in X, E x t is finite. 

Lemma 1.7. Let p be a finite non-zero P—invariant borelian measure on X. Then, 
S*p is a finite non-zero Q—invariant measure on X. 

Moreover, R*S*p = p and S*p is absolutely continuous with respect to p. 

Proof. First, for all non negative / 6 £?(X) and all x € X, Sf(x ) ^ Pf(x). 

So, f Sf dp ^ f Pfdp = f fdp since p is P— invariant and / is bounded. And this 
proves that S*p is absolutely continuous with respect to p. So, as Fubuni’s theorem 
proves that it is a— additive, S*p is a finite measure on X. 

Moreover, we saw in lemma 1.5 that for all non negative borelian function / on X, 
f SRfdp = f fdp and this proves that R*S*p = p. 

Then, we need to prove that S*pfX.) > 0. But, for all x 6 X, 

P k S(l)(x) = E x Sl(X k ) > P x ({r = k + 1}) 

So, YlkZ o P k S( 1) ^ P x ({t ^ n + 1}). And, as p is P— invariant, taking the integral 
on both sides, we get that, 

nS*p(X ) ^ f P x ({t ^ n})dp(x) 
iiex 

Finally, we use that for p- a.e. iGX, lim n P x (r ^ n) = 1 and the dominated convergence 
theorem, tells us that 0 < /u(X) ^ lim nS*p(X), so S*p(X) >0. □ 

Lemma 1.8. Let v be a non-zero Q—invariant borelian measure on X. Then, R*v is a 
non zero P—invariant measure on X. 

Moreover, S*R*i / = v and v is absolutely continuous with respect to R k u. 

Finally, if QR( 1) is bounded on X, then R^u is a finite measure if and only if is is. 

Remark 1.9. The technical assumption QR1 bounded on X is reasonable. 

More specifically, using the same notations as in remark 1.3, we call Y linearily 
recurrent if sup ygY E v ty is finite. 

In this case, Rl(x) = E x ty and QRl{x) = E x i?l(X TY ) ^ sup yGY E ?/ ty since for any 
x G X, P x (X TY S Y) = 1 be definition of r Y . 

Proof. To prove that R*p is a measure, one just have to prove that it is a— additive. 

Let (A n ) be a sequence of pairwise disjoint borelian subsets of X and n GN. As R is 
a linear operator, we have that f R( lu«_ 0 A fc )d^ = Ylk =o I Rd-A k dis, thus, R*v is finitely 
additive. But, according to the monotone convergence theorem, the left side of this 
equation converges to f R(l U A n )dis and this finishes the proof that R*v is a—additive. 

Moreover, for all non negative / £ £>(X), / ^ Rf, so v(f) ^ v(Rf) and v is absolutely 
continuous with respect to R*is and R*is(X) > 0. 

Then, proposition 1.4 shows that for any positive borelian function /, Rf + Qf = 
f + RPf. Applying this to / = 1a for some borelian set A, and taking the integral over 
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v, we get that f RIa + = j 1 a + RP\a&v. But, v is Q— invariant so if v{A) is 

finite, we get that f Pl^dv = f PPl^du. If v(A) is infinite, the result still holds since 
in this case, f Pl^du = v{A) = Q*n(A) = f PPl^du = +oo. Thus, for any borelian 
set A, R*v(A) = P*R*v(A) that is to say, R*u is P— invariant. 

As RS = Q and u is Q— invariant, we directly have that S*R*u = v. 

For the last point, assume that QR{ 1) is a bounded function on X. 

If R*u is finite, then so is v since u(X) ^ P*z/(X). 

Assume that v is finite. Then according to Chacon-Ornstein’s ergodic theorem (see 
chapter 3 theorem 3.4 in [Kre85]), there exist a Q— invariant non negative borelian 
function g * such that J g*du = j Rldv and for v— almost every x E X, 

. 71—1 

-J2Q k Rl(x)^g*(x) 
n z —■' 
k =o 

And, since QR is bounded on X and Rl(x) = E x t is finite, we get that g*(x) ^ ||Q^||oo 
for v —a.e x € X. So, g E L°°(X, v) C L 1 (X,u) since u(X) < +oo and f Rldv ^ 
WQRW^iX) < +oo. □ 

We saw in the previous lemmas that R ans S act on invariant measure. As they 
are linear operators and the set of invariant measures is convex, next proposition shows 
that they also preserve the ergodic measures (in some sense since they do not preserve 
probability measures). 

Corollary 1.10. Let (X n ) be a Markov chain on a complete separable metric space X 
and t a 6— compatible stopping time such that for any x E X, E x t is finite. Define P, 
Q, R and S as previously and assume that QR1 is bounded on X. 

Then, S* and R* are reciproqual linear bijections between the P— invariant finite mea¬ 
sures and the Q—invariant ones which preserve ergodicity. 

Proof. We already saw in lemma 1.7 and 1.8 that S * (resp R*) maps the P—invariant 
(resp. Q— invariant) finite non zero measures onto the Q— invariant (resp. P— invariant) 
ones and that they are reciproqual to each-other. 

Thus, it remains to prove that the image by S * or R* of an ergodic measure still 
is ergodic. To do so, we use the linearity of S* and R* and that ergodic probability 
measures are extreme points of the set of invariant probability measures for a Markov 
chain in a complete separable metric space. 

Let fi be a P—ergodic finite non zero measure. We assume without any loss of gener¬ 
ality that g is a probability measure. We saw in lemma 1.7 that S*g is a Q—invariant 
non zero finite measure. 

Assume that S*g = »S’*/i(X) (tv\ + (1 — t)^) where u\ and V 2 are two Q— invariant 
probability measures and t E [0,1]. 

Then, we get that g = R*S*g = S*g(X)(tR k v\ + (1 — t)R*V 2 ). But g is ergodic, so 
R*zu(X) = r* v a(x) And applyting S* again, we obtain that = u 2 , hence, 

S*g is Q— ergodic. 

The same proof holds to show that if v is Q— ergodic, then R*u is P—ergodic. □ 
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2. Drift functions 

In this part, (X n ) is a Markov chain on complete separable metric space X and r is 
a 9 —compatible stopping time such that for any x E X, E x t is hnite. 

We are going to study functions that we call “Drift functions” and that allow us 
to control the Markov chain. These functions are implictely defined by many authors 
and our main reference for their study is the book of Meyne and Tweedie [MT93] . We 
introduce a functional analysis point of view that will allow us to exactly link the original 
operator and the induced one. 

Definition 2.1 (Drift functions). We call drift function any borelian function u : X —> 
[1, Too [ such that u—Pu is bounded from below and Qu, ^ and P ^_pu+b' 1 are bounded 
on X where B = sup x Pu — u + 1. 

We will explain the techniqual assumptions of this definition in remark 2.13 after some 
other definitions. 

Remark 2.2. We assumed, in the definition of drift functions, that they are finite on 
X. It is convenient since it avoids things like “a point x such that u(x) is finite” or 
“a measure p such that p({u is finite}) > 0” however, sometimes, there is a natural 
function u which is not finite on X and we may not want to work with the (standard 
Borelian) space {x;u(x) is finite}. 

Definition 2.3 ((ip, r)— reccurence). Let r be a stopping time and ip be an increas¬ 
ing function <p : N —> M+ such that <p(l) = 1, E x t( t ) is finite for all x E X and 
liminf -ip(n) 7^ 0 (the last a ssumption is equivalent to saying there exist C E such 
that for any n in N*, ip(n ) ^ Cn therefore, Er ^ ^E <p(t)). 

We say that a borelian subset Y of X is (ip, r)—recurrent if for all x in X, P x (X T E 
Y) = 1 and 

sup E y(p(r) < oo 
s/e y 

Lemma 2.4. Let Y be a (ip,r) — recurrent set. 

Then the function u^ defined on X by u v (x) = E x ip(r) is a drift function. 

Proof. Let b v = 1 + sup^gY E y (/?(r). 

We note u v , the function u^{x) = K x ip(r) and we define R and S as in §1. 

By definition, if Y is (ip, r)—recurrent then, Su^ ^ Qu^ ^ b^. 

Moreover, 

Pu ip (x) = / ip(r — l)dE x T Su v (x) ^ u v (x) T — 1 
J{t^ 2 } 

since ip is non decreasing. Hence, 1 ^ — Pu^ T and is a drift function. □ 

Definition 2.5. With the same notations as in the previous definition, if <p(n) = n (resp. 
ip(n) = n 2 , <p(n) = a l ~ n for some a E]0, 1[), we say that Y is linearly (resp. quadrat- 
ically, exponentially) reccurent and that u v is a linear (resp. quadratic, exponential) 
drift function. 

If there can be no confusion on the stopping time, we simply say that Y is recurrent. 
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Definition 2.6. For a borelian function v : X — > [1, oo[ and p £ [1, +oo[, we note 

PiffX.) = // : X —> M; / is borelian and sup ^ is finite! 

I iex v{x) ) 

This clearly is a vectorial space and we endow it with a norm, setting, for / £ J-f (X), 

l/(®)l 


,f£(X) — SU P / U / D 

Thus, P%(X.) is a Banach space which countains borelian bounded functions on X. 


Remark 2.7. The use of this space is that, when v is a drift function, we are be able to 
deal with functions in J- '/(X) as if they were bounded. 

More specifically, with use the drift condition to have a control on what happens 
during the walk for functions of J 7 *. 

Remark 2.8. Let v\, v-i : X [1, oo[ be two borelian functions. Then v\ £ T 7 ,^ (X) if and 
only if Id : T 7 ^ (X) —> J 7 ,^ (X) is continuous. 

Thus, if u : X —> [1, +oo[ is a borelian function such that Pu — u is bounded from 
above, we note B u = sup Pu — u + 1 and we clearly have that 1 ^ u — Pu + B u . 

Morover, if B' ^ B u , we get that 1 ^ u—Pu+B u ^ u—Pu+B' ^ (1 +B'){u—Pu+B u ). 
Therefore, P Z-p u +B n anc ^ ^ u-Pu+b ' are isomorphic as Banach spaces. 

Definition 2.9. Let u : X —» [1, +oo[ be a drift function. 

We note B u = sup Pit — u + 1 and we set, for p £ [1, +oo[, £ P (X) = J rP _ Pu+B (X). 

Lemma 2.10. Let u be a drift function. The three following assertions are equivalent : 

• The spaces and are isomorphic 

• There is a £ [0,1 [ and b £ M such that Pu ^ au + b 

• u £ £l 


Proof. That the first and the third assertions are equivalent follows from remark 2.8. 

Moreover, if there is a £ [0,1 [ and b £ M such that Pu ^ au + b, then (1 — a)u ^ 
u — Pu + b and so, u £ 

In the same way, if «£<?*, then write u ^ {u ~ Pu + B u ) and this means, since 

||tt||£i yl 0, that 


Pu ^ 



u T B u 


which finishes the proof. 

Actually, we also proves that if u £ and IMIfi ^ 1, then Pu is bounded. □ 


From now on, we fix a drift function u (we assume that one exists). 


Remark 2.11. To simplify the lecture of this section, the reader may think of u as being 
an exponential drift function and thus, forget about the difference between Sf and Ff. 
He may also fix p = 1. 

Lemma 2.12. The operator R is continuous from £^(X) to Pi (X). 
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Proof. Let / £ £*(X) and x E X., R is positive operator, so 

\Rf(x)\ < i*|/|(z) < ||/||£li?(« - + B u ) 

But proposition 1.4 shows that if Ru(x) is finite, then R(u — Pu)(x ) = u(x) — Qu(x) 
(because u and Qu are assumed to be finite on X). We are going to prove that this 
relation holds even if Ru(x) is not finite. This will be enough to conclude because Qu is 
bounded, Er ^ Cu for some C £ M (by definition of u ) and because of remark 2.8. 

Let A n = H x k) - P< x k) + B u ). 

We assumed that u — Pu + B u ^ 1, so A n+ \ — A n = u(X n ) — Pu(X n ) + B u ^ 0. 

Let M n = A n - u(X 0 ) + u(X n ) - nB u = YZ =o u ( x k+1 ) - Pu( x k), M n is a martingale. 
Moreover, E X M 1 = 0 and so Ex(^mm(n, r )) = u(x) - E x u(X min ^) + B u E x min(T,n). 
Therefore, according to the monotone convergence theorem, 

R(u — Pu + B u )(x) = E x A t = u(x) — Qu(x) + B u E x t 

Hence, \Rf(x)\ < \\f\\ e i(u(x) - Qu(x) + B u E x t) ^ ||/|| £ i(l + B u \\Et\\jti)u(x) since u is 
positive and Er £ J^(X) by assumption. 

So, we finally get that ||i?/||j-i ^ (1 + H M ||Er||jri)||/|| f i and this finishes the proof of 
the lemma. □ 

Remark 2.13. Our assumptions in the definition of drift functions exactly say that if 
u is one, then X\ and are defined, P : £,* (X) -a £^(X), Q : X^fX.) -A H(X) are 
continuous and finally, R(l) £ Xf. 

Lemma 2.14. The operator S is continuous from X\ to £>(X). 

Proof. First, we remark that S' is a positive operator and that for any non negative 
borelian function g, Sg ^ Qg. Therefore, if g £ X\. 

I-S'ffl < S(\g\) H 5 ll.Fi Su ^ \\g\\jriQu ^ ||^||jn||Qu||oo 

So, Sg is bounded and HSgjloo ^ llffll^iIIQ^Iloo- El 

Proposition 2.15. For any f £ £^(X) and g £ J^(X) ; we have 

R(i d - P)f = (h - Q)f 
(I d - P)Rf = (I d - SR)f 
(Id - P)Qg = S(I d - Q)g 
RSg = Qg 

Proof. This is just a consequence of proposition 1.4 and the previous lemmas which 
shows that all the functions Rf, RPf, f, Qf, etc. are finite. □ 

Remark 2.16. As Q = RS in X.Q acts on J 7 */ker(S) and it’s spectrum in X\ is the 
same as the one in X^/Ker(S). 

So, if we can solve Rf = g — Qg in X^/Ker(S) we may not solve it in X x a but the 
functions Sg and Qg will be defined anyway. 

Note that, if Y is a measurable recurrent subset of X and r is the time of first return 
to Y, then Ker(S) = {g £ X^; g = 0 on Y}. 
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Remark 2.17. Let / £ £,], if there exist a bounded function g £ J 7 ,* / ker S’ such that 
5 — Qq = Rf i then g = Rf + Qg is well defined as we saw in the previous remark. 

Moreover, it satisfies g — Pg = f . This is a direct computation using the relations of 
proposition 2.15 : 

Rf + Qg- P{Rf + Qg) = (h - P)Rf + (h - P)Qg = (h - SR)f + S(l d - Q)g 

= / + S(g — Qg — Rf) = f 

This, proves that if we can solve Poisson’s equation for the induced chain, we can find 
solutions for the original chain. 

Finally, Rf + Qg £ J 7 *. 

The next two lemmas proves that the spaces £ p and J- p are really close (in some sense) 
to the spaces of functions that are integrable against the stationnary measures of the 
original and the induced random walk. 


Lemma 2.18. Let g be a P—invariant non zero finite measure on X. 

Then, I d :£ p {X)^£ p (X,g) is continuous. 

Proof, (we use the same idea as Benoist and Quint in [BQ13] Lemma 3.8) 

We assume without any loss of generality that g is a probability measure. 

Let / £ £u, x £ X and n £ N*, by definition of £ p , \f\ p (x) ^ \\f\\ p P (u — Pu + b)(x), so 

n-l \\f\\ P 1 

£P fc (|/f)(x) < —^ l( u -P n u + nb ) ^ \\f\\ p (- u (x) + b) 

^ 77 , °u n 


l 

n 


k =o 


n 


Then according to Chacon-Ornstein’s ergodic theorem (see chapter 3 theorem 3.4 in the 
book of Krengel [Kre85]), there exist a P— invariant non negative borelian function /* 
such that f \f\ p dg = f f*dg and for g— almost every a: £ X, 


n— 1 


n 


X p k \/n*) -> rw 


k=0 

And, since u(x) is finite for all x £ X, we get that f*(x) ^ b||/||^ P for g— a.e x £ X. 
So, f* £ L°°(X, g) C L 1 (X, g) since g(X) < +oo, / £ C p (X,g) and ||/||/>(x, M ) < 
b 1/p \\f\\ £ p. □ 

Lemma 2.19. Let u be a Q—invariant non zero finite measure on X. 

Then, I d : PufX.) — > £ P (X, v) is continuous. 

Proof. We use the same idea as in lemma 2.18. 

We assume without any loss of generality that v is a probability measure. 


Let g £ P p , a; £ X and n £ N*, 

i n_1 llg|| p p n_1 

- Q k \g\ p {x) ^ Q k (u - Qu + MEt) ^ 

77 , L ^ n z ' 


J u 


n— 1 


U — 


k=0 


n 


k=0 


n 


Q n u + y^ Q k Er 


k=0 
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But, by definition of u, Et G J ^ and for k 1, Q k (u) ^ ||Qu||oo < +oo, so 
1 n_1 ||o||P 

- Y, Q k \9\ P (x) < —^(2u + (n - l)||Q«||oc) 
n n 

fc=o 

According to Chacon-Ornstein’s ergodic theorem, there exist a Q—invariant function 
such that f \g\ p dv = f g*dis and for n—almost every i£X, 

- n—1 

-YQ k \gl p (x)->g*(x) 

k= 0 

As u is finite on X, we get that g * ^ ||Qit||oo||5l|^pj so 5* £ L°°(X, z/) C L 1 (X,z^) and 
\g\ p G L 1 (X, v). 

Thus, \\g\\cp(x,v) = (f g*dv) l/p ^ ||Qu||^ p ||g||^. □ 

Let 

Y = {Tg (££)*; V/ G £ p T(f ) = T(Si?/)} = Xer(/ d - i2*S*) 

JT = {TG p*)*; V 5 G = T(RSg)} = Ker(I d - S*R*) 

Corollary 2.20. If u is a drift function, £q* and Fq* are two Banach spaces and, 
S * : £%* —> F^ and i?* : F%* -A are continuous and reciproqual. 

Proof The proof is direct from lemma 2.12, 2.14 and 2.15 . □ 


3. The LLN, the CLT and the LIL for martingales bounded by a Drift 

FUNCTION 

First, we extend Breiman’s law of large numbers for martingales (see [Bre60]) for 
measurable functions such that f 1+a G £ „ for some a > 0 

Lemma 3.1. Let u be a drift function, x G X, and a G K+, 


sup 

nSN k=Q 


P k (u — Pu) 

(k + 1 )“ 


Proof This is a direct computation : 


X 

k =0 


P k (u — Pu) 

(fc + 1)“ 


X 

k =0 
n 


1 


-p k u-Y 

t Z—/ 


(fc + l) Q ^(fc+1)' 


^ u(x) 


-P k+1 u 


= ti n 1 \ - A)/*' » + U - 

Yi( k + 1)“ (n + l) c 

^ u(x) since u is non negative 


P n+1 u 


□ 


Lemma 3.2. Let u be a drift function and a G M* . Then, for all f G £\ and all x G X 
such that u(x) is finite, 

f(X n ) —> 0 a.e. and in L 1 (P X ) 


1+a 


n 
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Proof. We compute 


V x \f(X n )\ ^ \\f\\ u E x u(X n ) - Pu{X n ) + b 


P n [u — Pu + b) 


So, 


® x \f(x k )\ 

h* ( k + i ) 1+a 




n 


E 


P k (u-Pu) 
(k + l) 1+a 


n 

+‘E 


fc =0 


1 

(k + 1) 1+Q 


^ u(x) + b 

neN* 


1 

n 1+a 


where we used lemma 3.1 to bound the first sum. 
So, for any iEX such that u{x) is finite, 


v x \f(x k )\ 

h'o(*+ 1 ) 1+ “ 

is finite. 

This proves the convergence in L 1 (P X ) and to get the a.e.— one, we use Borel-Cantelli’s 
theorem since for any e E ME, 


+oo 

E p 


n= 0 


( \ 1 E x \f(X k )\ 

V(n + 1) 1+Q ^ / e ^ (k + 1) 1+Q 


□ 


Proposition 3.3 (Law of large numbers for martingales). 

Let u be a drift function and a E M+. For all f E £l +a and all x E X, 

- n— 1 

- V f(X k+1 ) - Pf(X k ) -> 0 P x - a.e. and in L 1+ "(P a; ) 

n z — J 

k =o 

Proo/. Let M n = f(X k+1 ) - Pf(X k ). 

M n is a martingale of null expectation. 

And 


E x \M n+1 - M n 1 1+ “ = E x |/(X n+1 ) - P/(A n )| 1+a = P”(E a; |/(X 1 ) - Pf(x)\ 1+a ) 
< P n+1 (|/r +a )(x) ^ |||/| 1+ “|U_p u+6 P n+1 («- Pn + 6) 

Hence, 


+00 1 

Y+T Ea: l Mri + 1 


- M r 


11+a 


< 11 / 


n=l 


i+an ^pn+l {u _ Pu + b) 

II u-Pu+b 2_^ n l +a 

n =1 


+oo 


< ll/ 1+ "IU-P«+6 «(-^) + b ^2 


k =0 


n 


1 

1 +a 


And using the strong law of large numbers for martingales (see theorem 2.18 in [HH80]), 
we get that E M n —> 0 P x —a.e. and in L 1+ “(P X ). □ 


Using the same kind of trick, we can prove the following 
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Lemma 3.4. Let u be a drift function and let a £ M+ 
Let g £ £ 2+a an d x £ X be such that u(x) is finite. 
Then, for any e £ Ml. 


n— 1 


[(g(X k+1 ) - Pg(X k )) 2 l lg{Xk+i y Pg[Xk)l>£V ^j --^ + -> 0 


and 


k=0 
+ 00 


2 (b(^n+l) - l| ff (Y„ +1 )-P 9 (X n )|>eVH) fi nite 


n= 1 

Finally, there is 6 £ M+ sued that 

+oo ^ 


n 2^ x Pg(X n )) l|g(X n+1 )—Pg(X„)|<i5v / n) 


n=l 


is finite. 

Proof. Using Markov’s property and inequality, we have that, 

P k (E {g{X l ) - Pg(X 0 )f +a 


E, 


{h(X k+ i,X k ) l|/ l (x fc+ i,X fe )|^eUn 


£ 


e“n“/ 2 


where we noted h(x,y) = g(x) — Pg{y). 


But, E x 
and so, 


{(g{Xi) - Pg{Xo)) e £«, since g £ £ 2+a . 


n n— 1 

-E E * (^(^ +1 ,^) 2 l| M x fc+1 ,x fc )|^vH) < Cn 1 + “/V^P fc (n-Pu + 6 ) 

k= 1 fc=0 




C . . 6C 
-n(x)+ 


n l+a/ 2 e a n“/ 2 e“ 

And the right side of this inequality goes to 0 when n goes to infinity. 

The two sums we have to bound are dominated by constants times 

+OO 


E 

n =1 


1 


^l+a/2 


E, 


(\g(x n+l) Pgi^r i)| 


2+a 


and, once again, using that g £ £ 2+ “, we have that 

E x (\g(X n+ 1 ) - P 5 (A n )| 2+ “) ^ || 5 || f 2 +Q P n (n - Pn + 6) 
And we conclude with lemma 3.1. 


□ 


Lemma 3.4 is actually the first step in the proof of the Central limit theorem and of 
the law of iterated logarithm for martingales as we see in next 

Corollary 3.5 (Central Limit Theorem and Law of the Iterated Logarithm for martin¬ 
gales). Let u be a drift function and a £ Mlj_. 

Let g £ £ 2+a and x £ X be such that u(x) is finite. 
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If 


n—l 


1 

-Y J n9 2 ){x k )-{p 9 {x k )f 


k =0 


converges in L 1 (P X ) and almost-everywhere, to some cr 2 (g,x) ^ 0, then 


^ n—l 

7 = E 9( x k+ 1 ) - AA( 0 , cx 2 ( 5 , x)) 

/77 n—too 


k=0 


Moreover, 


and 


y/2na 2 (g, x) lnln(n) 


y2ncr 2 (g,x) lnln(?7) 


Proof. The first convergence is a straightforward consequence of Brown’s central limit 
theorem for martingales (see [Bro71]) since the so called Lindeberg condition holds when 
the space has a drift function, according to lemma 3.4. 

The Law of the iterated logarithm is given by corollary 4.2 and theorem 4.8 of Hall 
and Heyde in [HH80] since the assumptions of corollary hold according to lemma 3.4. □ 

Remark 3.6. If g £ £ 2+a , lemma 3.2 proves that g(X n )/ \fn converges to 0 in L 1 (P a .) 
and a.e. so the previous results still holds if we look at Ylk=o 9{Xfi) — Pg{X]f) instead 
of J2k=o 9(Xk+i) ~ Pg(X k ). We will use this remark in the sequel to study functions / 
that can be written f = g — Pg with g £ £ 2+Q . 


4. Application to a random walk on a half line 


In this section, we apply the previous properties to a random walk on M + . 

Let p be a probability measure on M. For xo £ M_(_, we define the random walk (X n ) 
driven by p and starting at xq by 


f X 0 = x 0 

( X n +i — max(X n + Y n - |_i,0) 


where (Y n ) has law p 

This random walk on a half-line is a model for storage systems and queueing processes. 
In their book [MT93], Meyne and Tweedie study the recurrence properties of the walk 
and in [Lal95], Lalley studies the return probabilities for this walk. 

It is clear that if suppp C ML, then, for any starting point x, and a.e. (Y n ), the 
walk stays at 0 after a finite number of steps. But, if p(ML) > 0, then the walk is not 
bounded : for any M £ M + and any x £ M + , P, x (sup n X n ^ M ) = 0. 


First, we have the following 


Proposition 4.1. Let p be a probability measure on M having a finite first moment. 
Then, if r is the (6— compatible) stopping time defined by 

r((X n )) = inf{n £ N*|X n _! + Y n ^ 0} 
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we have that for any x G M+, E x t (in particular, r is a.e. finite). 

Moreover, there is a P—invariant probability measure p, on M + and it is given, for 
any borelian bounded function f, by 

i T ~ 1 

^f) = —¥. 0 ^f(X k ) 


k =0 


Proof That for any x G M+, E x t is finite conies from proposition 18.1 in [Spi64]. 

Let Q be the induced operator by r and R and S be the operators associated to r 
and defined by equations 1.2 and 1.1. The measure p now writes : 

Rf( o) 


M/) = 


m(o) 


So, it is a probability measure and according to 2.15 we have that for any borelian 
bounded function /, 

R(I d - P)f( 0) = (I d - Q)f{ 0) = /(0) - K x (f(Xr)) = /(0) - /(0) = 0 

thus, the measure p is P— invariant, (to apply proposition 2.15, we choose u(x) = E x t 
since then, Pu(x) = f^ r>2 j T ~ 1 + fr , _ n 7-2 = u ( x ) — 1 + EotP x (t = 1) and 
drift function). 


so, u is a 
□ 


Lemma 4.2. Let s G [l,+oo[ be such that f m \y\ s dp{y) is finite. 
Then, 

max (a; + y, 0) s — x 
-s -1 


lim 

x —>-+oo 


Proof. Let’s compute, for x large, 
f max(x + y, 0) s — x 


— 1 


d p(y) = / (~x 


d p(y) =s ydp(y) 

Jr 

+°° (x + y) s - x s 


)dp(y) + j 


r S— 1 


d p(y) 


= -xp(]-oo,-x]) + J ®((l + |) _ 1 ) d p(l/) 


Note, for u G [— 1,0[U]0, +oo[, 


T(u) = 


(1 + u) s — 1 — su 


Then, lim u _ >0 + ip(u) = 0 so we can extend ip by continuity at 0 and there is a constant 
C G M+ such that for any u G [—1, +oo[, |<^(it)| ^ (7(1 + |«| s ). Thus, we have that 

r<+00 


max(x + y, 0) s — x s 

S 1 


But, for any x G [l,+oo[, 


d p(y) = - xp{} - oo, -x]) + f x(s- + -</>(-)) dp(y) 

J _ qt* ' *X *Xj tX) X 

r+oo r+oo y 

2 /dp(y) + / yp(-)dp(y) 

—x J—x % 


= —xp(\ ~ OO, —x]) + S 


i]-x,+oo](y) y<p(p ^ c '|y |( 1 + 


\S -1 rT l 


GL \p) 
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and for any y G M, lim x ^ +0O l]_ x ,+oo](y) |M|)| = °> so the dominated convergence 
theorem proves that 

r +°° y 

Inn / y<p(~)dp(y) = 0 

a:—H-oo J_ x X 

Moreover, as Jf \y\dp(y) is finite, we have that 


/ —X 

\y\dp{y) = 0 

-oo 


But, 


/ —x r—x 

\y\dp(y) > / \x\dp(y) = \x\p(]-oo,-x])fzO 

-oo J — oo 

so lim x _ ? ._|_ 0O \x\p{\ — oo, — x}) = 0 and this finishes the proof of the lemma. 


□ 


Corollary 4.3. Let s G [l,+oo[ be such that J R |r/| s d/?(y) is finite. 

Define, for x G M+, u s (x) = 1 + |x| s . 

Then, there are a constants B S ,N S such that 

^ u s ~ Pu s + B s ^ N s u s -1 

■L'S 

Moreover, if s ^ 2, f/ien is a drift function and is continuously isomorphic to 

£ l 

‘-'Us ‘ 

In particular, u s -\ G L 1 (M + ,//). 


Proof. According to the previous lemma, we have 


Pu s (x)-u s (x) 

Inn -—- = s 

x-H-oo u s -i(x) 


ydp{y) < 0 


so, there are xq,£ G such that for any x ^ xq. u s (x) — Pu s (x ) ^ eu s - i(x). 

Now, the function £u s -\ + Pu s — u s is continuous on [0, xo] so it is bounded by some 
non negative constant that we note B s and we have that for any x G M+, 


£U s —l U s Pu s “t“ B s 


To find the other domination, we apply once again the previous lemma to find that 
(u s — Pu s + B s )/u s -1 is bounded. 

If s ^ 2, as u s -1 is non negative, this also proves that u s — Pu s is bounded from 
below. Moreover, Qu(x ) = u(0) is finite, E x t = Rl(x) and 1 G £ Ug so R1 G F Ug 
Finally, 

P(u s - Pu s + B s ) ^ N s Pu s -i ^ N s (u s -i + B s -i) 

^ N s (N s (u s — Pu s + B s ) + B s — i) 

and this finishes the proof that u s is a drift function for s ^ 2 . □ 


Proposition 4.4. Let p be a probability measure on M having a negative drift and a 
polynomial moment of order s for some s G [1, +oo[. 

Then, for any f G , there is g G Pffi such that f = g — Pg + f f dp. 
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Proof. Using, the previous corollary, we have that any / £ .F* belong to £^ s . More¬ 
over, we have, according to lemma 2.12, that R continuously maps £^ a onto J so, for 
any f e rt s _ v Rf e 

Finally, using the equations of proposition 2.15, we also have that 

(Id - P)Rf = f — SRf 

but for any x £ R+, 

SRf(x) = [ Rf(X l ) dP x ((X n )) = Rf(0)P x (r = 1) = R1(0)P x (t = 1) [ fdp 

J{t= 1 } J 

since, p(f) = So, applying this to f = f-J fdp, we get that SRf = 0, Rf <E P,) s 

and (I c i~P)Rf = f = f — f fdp so Rf is the required solution to Poisson’s equation. □ 

Proposition 4.5. Let p be a probability measure on M having a finite first moment and 
a negative drift A = f R ydp(y). 

Let a £ M+. 

such that f R \y\ 2+a+e dp(y) is finite, then for any f £ T\ a and any 


If there is e £ 
x £ M_|_, 


n— 1 


n 


£/(**) 


k =0 


n—>-+oo 


> / fdp a.e. and in L 1 (P X ) 


If there is e £ such that f R \y\ i+a+e dp(y) then for any f £ £ Ua and any x £ 


c 2 n(f,x) = -E x 


n 


n— 1 


/ /d/i 


k =0 


converges to some cr 2 (f) and if <J 2 (f) 0, then 


j=Y,f(X k )^ fdp,a 2 (f)\ 

k =0 ' 


and 


Efc= /(^)-l'/d/i , Jr . cEV 0 f(Xk)-ffdp , 

Inn sup- . = 1 a.e. and Inn ml- . = —1 a.e. 

y / 2ruj 2 (/) lnln(n) y / 2?wr 2 (/) lnln(n) 

Proof. The moment assumption and proposition 4.4 proves that for any / £ J 7 ,’ , there 
is g £ Xu a+1 such that / - / fdp = g - Pg. 


Moreover, F Ua+1 C £ Ua+2 so, for any a' £ M+, \g\ 1+a ' £ £t 
that \g\ £ £}f a ', , 

lal u (l+a')(a+2) 

Therefore, we can write 


(l+u')(a+2) 


. And this means 


n— 1 r. n— 1 

E f(X k ) - / fdp = g(X 0 ) - g(X n ) + £ g(X k+1 ) - Pg(X k ) 
fc=0 ' k =0 

and using lemma 3.2 and 3.3, we get the first expected result if there is e £ such 
that f R \y\ 2+a+£ dp(y) is finite and if we choose a' small enough. 
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Let us now compute, using the reverse triangular inequality in L 2 



-E* 

71—1 

2 

1/2 

1 

^ -j= 



Y J g{Xk+i)-Pg{x k ) 



E x \g(X 0 ) - g{X n )\ 2 



k=0 






1/2 


1 


1/2 1 


1 


E* \g(X 0 ) - g(X n )| 2 ^ ~^\g(X 0 )\ + -= (E x g 2 {X n )) 

\ n Jn 


l !/2 


and 


But, lemma 3.2 proves that if there is e E R+ such that J R \y\ A+a+e dp(y) is finite and if 
we choose a' = 1 + a" with a" small enough, then 

— E x g 2 (X n ) -A 0 


n 


Moreover, {Y2k=o 9( X k+i) — Pg(Xk)) n is a martingales and so 


E, 


n —1 


X>(*k+i) - Pg{x k ) 


k=0 


71—1 


^E x ( 5 (X fc+ 1 )-P 5 (X fc )) 2 

k=0 

71—1 

E^P( 5 2 )(X fc )-(P 5 ) 2 (X fc ) 


fc =0 


and applying the first part of the proposition to P{g 2 ) and to ( Pg ) 2 , we get that 


n— 1 

-^P 5 2 (X fc )-(P 5 (X fc )) 2 -> 

k=0 

so, (J 2 (/, x) also converges to f g 2 — {Pg) 2 dp and if cr 2 (/) ^Owe can apply corollary 3.5 
to get the central limit theorem and the law of the iterated logarithm. □ 


J g 2 — {Pg) 2 dg a.e. and in L 1 (P x ) 
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